Method and system for navigating a display screen for locating a desired item of information

ABSTRACT

A method and a system for navigating a display screen to search for a desired item of information stored in an electronic device. The electronic device includes a novel fly over user interface (FOUI) capable of receiving commands from a user to provide a zoom out view of the display screen. A user may commence a navigation session by touching the display screen in a non active area or by clicking on a specifically designated icon to activate the user interface. During the navigation session, the display screen is zoomed-out and a magnifying area may appear on the display screen. The user interface enables the user to scroll the zoomed-out display screen by dragging the magnifying area towards an edge of the display screen to find a desired item of information. The display screen may be a display screen of a digital device (e.g., portable computer, personal computer, a cellular telephone, a digital watch, etc). The user may terminate a navigation session by removing the pointer from the display screen.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation application of application Ser. No.11/484,109, entitled “METHOD AND SYSTEM FOR NAVIGATING A DISPLAY SCREENFOR LOCATING A DESIRED ITEM OF INFORMATION,” filed Jul. 11, 2006, whichis a continuation application of application Ser. No. 10/071,816,entitled “METHOD AND SYSTEM FOR NAVIGATING A DISPLAY SCREEN FOR LOCATINGA DESIRED ITEM OF INFORMATION,” filed Feb. 7, 2002, now U.S. Pat. No.7,075,512, and assigned to the assignee of the present application. Thesubject matter in the above-identified co-pending and commonly ownedapplication(s) is incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to the field of computer systems and datacommunication. More specifically embodiments of the present inventionrelate to the field of displaying information on screens of portableelectronic devices, such as personal computers, personal digitalassistants (PDAs), cell phones, pagers, digital watches, etc.

2. Related Art

The popularity of portable computers caused consumer demand for newfeatures that are commensurate with the nature and method of use ofportable devices. Furthermore, the advent of the Internet and everincreasing reliance on electronic mail presented more requirementsregarding how portable devices interface with the Internet andelectronic mail systems.

To respond to the market demand, manufacturers incorporated customerrequirements into the design of their new products and made improvementsin their existing capabilities. An improved portable computer,responding to the consumer requirements, requires a display capable ofshowing a plurality of icons and information. The icons may representany information, e.g., an assortment of sorted data in a data base,pages of information down-loaded from the Internet, pages of textreceived via electronic-mail, and in some instances maps of citiesdisplaying street lay-outs and the like.

Displaying pages of textual data, maps of cities or the ever-increasingnumber of icons takes a vast amount of display screen area. However,supporting such features is not compatible with the customerrequirements for a “small size device.” Therefore, the designers of aportable computer have to either limit their designs to display screenscapable of displaying a smaller amount of information or to enlarge thesize of the display, neither of which may satisfy all customerrequirements.

Furthermore, portable electronic devices are typically employed whilethe user is on the run, e.g., in business meetings, on business travel,personal travel, in a vehicle, on foot, etc. Ideally, a user of aportable device needs to retrieve a maximum amount of information,display the information on a limited amount of display space, and in theshortest period of time. Such constraints can benefit from an improvedsystem or an improved method for searching and presenting theinformation to the user. Conventional portable electronic devices canbenefit from improved methods of retrieving, displaying and legiblypresenting information to users.

Thus a need exists for a device capable of retrieving information with aminimum number of inquiries. Furthermore, a need exists for a user to beable to search and retrieve desired data in an expeditious manner.Additionally, a need exist for a user-friendly device that is easilyportable, contains a large amount of information which can be sorted andconveniently retrieved. The present invention provides a novel solutionto these requirements.

SUMMARY OF THE INVENTION

An embodiment of the present invention enables a user to retrieve adesired item of information from a large number of items of informationstored in a portable computer with a minimum number of inquiries.Typically, the information displayed on a display screen of the portablecomputer is virtually expanded in all directions, outside the viewingarea of a user of the portable computer. Furthermore, zoomed-out fontsand images are used to fit large documents received from the Internet,via the e-mail or the like on a small display screen of a portablecomputer. An electronic magnifier is placed over the zoomed-outinformation displayed on the display screen.

The magnifier can be used, similar to a pointer in a conventionalpersonal computer, to scroll the displayed information in all directionswhile the information passes under the magnifier. As the informationpasses under the magnifier, a user can bring to view the informationbeyond the viewing area and with enhanced legibility due tomagnification.

According to one embodiment of the present invention a user points apointer (e.g., a stylus, a mouse pointer, or even the user's finger) atthe display screen invoking a Fly Over user interface (FOUI). Invocationof the FOUI initiates a search or a navigation session. The navigationsession is initiated when the current view is zoomed-out and amagnifying rectangle appears on the display screen over the displayeditems of information. Accordingly, the items of information directlyunder and within the magnifying rectangle are zoomed-out by an order of2-n degrees of magnification, which makes the information clearlyvisible and legible to the user. In one embodiment of the presentinvention a user determines the degree of magnification and zoom-out ofthe items.

Another embodiment of the present invention enables a user to scroll thedisplayed information by moving the magnifying rectangle in alldirections in search of the desired item of information while thedisplayed information are passing under the magnifying rectangle and aremagnified. The present invention enables a user to search forinformation in different layers and sub-layers. The user may terminatethe navigation session by removing the pointer from the display screenand the invention allows the user to resume with the normal operation ofthe device.

More specifically, embodiments of the present invention are directed toa method for retrieving information providing a magnifying window on adisplay of a digital device wherein the display shows a plurality ofitems. The user activates the magnifying window by touching the screenwith a pointer. The user scrolls the magnifying window over the displayscreen and locates a desired item of information of the plurality ofitems of information. By pointing on the desired item of information,detail information can be displayed. Removing the pointer from thescreen deactivates magnifying window, restores view zoom factor andterminates the navigation session.

Embodiments of the present invention are also directed to a method and asystem for navigating through information of a display screen to searchfor a desired item of information stored in an electronic device. Theelectronic device includes a user interface capable of receivingcommands from a pointer to activate a magnifying window. A user maycommence a navigation session by touching the display screen in anon-active area or by clicking on a specifically designated icon toactivate the user interface. The user interface enables the user toscroll the magnifying window in all directions over the zoomed-outdisplay to find a desired item of information. The display may be adisplay screen of a digital device (e.g., portable computer, personalcomputer, a cellular telephone, a digital watch, etc). The user may dragthe pointer over the desired item of information to retrieve detailedinformation contained therein. The user may terminate a navigationsession by removing the pointer from the screen and resuming normaloperation.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 depicts a typical portable computer with a plurality of iconsdisplayed on its display screen.

FIG. 2 depicts the display screen of a typical portable computer when anavigation session is initiated and, in response, the display iszoomed-out and a magnifying rectangle appears on the display screen.

FIG. 3 illustrates the movement of a magnifying rectangle and thescrolling of the information while a user is searching for a desireditem of information.

FIG. 4A and FIG. 4B illustrate a search for a desired item ofinformation while FOUI magnifies the displayed information therebyenhancing the visibility and facilitating the search.

FIG. 5A is an exemplary illustration of an embodiment of the presentinvention searching for and finding an address on a portable computer.

FIGS. 5B, 5C and 5D are an exemplary illustrations of embodiments of thepresent invention viewing the address and a map of a desired address.

FIG. 6 is a flowchart of the steps of a process 600 of initiating a FlyOver user interface (FOUI) and navigation of information in search of adesired item of information in accordance with an embodiment of thepresent invention.

DETAILED DESCRIPTION OF THE INVENTION

Reference will now be made in detail to the preferred embodiments of thepresent invention, a method and a system for navigating a display screenfor locating a desired item of information, examples of which areillustrated in the accompanying drawings. While the invention will bedescribed in conjunction with the preferred embodiments, it will beunderstood that they are not intended to limit the invention to theseembodiments. On the contrary, the invention is intended to coveralternatives, modifications and equivalents, which may be includedwithin the spirit and scope of the invention as defined by the appendedclaims.

The present invention is compatible with any electronic device having awireless or other communication mechanism and contains organized recordsof information, such as a portable computer system, a cell phone, adigital watch or a pager. One of the common types of electronic systems,which can be used in accordance with one embodiment of the presentinvention, is referred to as a personal digital assistant, or commonlycalled a PDA. The PDA is a pocket sized electronic organizer with thecapability to store telephone numbers, addresses, daily appointment, andsoftware that keeps track of business or personal data such as expenses,etc. Furthermore, the PDA also has the ability to connect to a personalcomputer, enabling the two devices to exchange updated information thatis synchronizing the information between the two devices. Additionally,the PDA can also be connected to a modem, enabling it to have electronicmail (email) capabilities over the Internet along with other Internetcapabilities. Moreover, an advanced PDA can have Internet capabilitiesover a wireless communication interface (e.g., radio interface).

In particular, the PDA can be used to browse Web pages located on theInternet. The PDA can be coupled to a networking environment. It shouldbe appreciated that embodiments of the present invention are well suitedto operate within a wide variety of electronic systems (e.g., computersystems) which can be communicatively coupled to a networkingenvironment, including cellular phones, digital watches, pagers, etc.

FIG. 1 depicts an exemplary Personal Digital Assistant (PDA) 100. ThePDA 100 is also known as a palmtop or palm-sized electronic device orportable computer system. The PDA 100 stores substantial items ofinformation in its memory. The information may be stored in accordancewith a plurality of views of a database organized in different filescreated by a user. Numerous icons, represented by circles in FIG. 1,displayed on display screen 110 (e.g., graphical user interface) mayrepresent a plurality of databases or files stored in memory. Each icondisplayed on display screen 110 is labeled to identify the file or thedatabase it represents.

For example icon 130 may represent a file storing all received e-mails.Similarly icon 120 may represent a file where maps of different citiesare stored, or icon 150 may be associated with a data base view of allexpenses by the user during January 2000. A user can retrieveinformation associated with an icon by activating that particular icon.An icon may be activated in a variety of methods (e.g., touching theicon with a stylus, touching the icon with the user finger, touching theicon with a pointer or the likes).

The PDA 100 also has the capability to transmit and receive data andinformation over a wireless communication interface (e.g., a radiointerface). The PDA 100 implements an exemplary graphical user interfaceproviding a fly over mode.

In one embodiment of the present invention icon 190 is specificallydesigned for the purpose of invoking the fly over mode. A user caninvoke fly over mode by touching a non-active area 180 of display screen110 with stylus 210 or in the alternative click on icon 190. It isappreciated that the non-active area 180 of display screen 110 may be anarea which is not occupied by icons.

FIG. 2 depicts an embodiment of the present invention, where a user mayinitiate a fly over mode. During the fly over mode, a larger number oficons and fly over area 220 appear on display screen 110. FIG. 2illustrates an exemplary view of display screen 110 during fly over modewhile fly over area 220 is placed over icon 230. Icon 230 viewed throughthe fly over area 220 appears larger than the other icons on displayscreen 110. During fly over mode, not all icons can be displayed ondisplay screen 110. The display of some of the icons is extended beyondthe borders of display screen 110. However, all icons can be broughtinto view on display screen 110 by scrolling the icons in directions130, 140 and 160 of FIG. 1.

For example, FIG. 1 depicts PDA 100 during a normal mode of operationshowing a small number of icons on display screen 110, although a largenumber of icons are extended outside the viewing area and not visible tothe user. FIG. 2 illustrates the viewing area of display screen 110after fly over mode is invoked. During the fly over mode, a largernumber of icons, smaller in size (e.g., feature size), appear on theviewing area of display screen 110. Appearance of a larger number oficons on display screen 110 facilitates a subsequent search for a targeticon. During this session, a user has access to a larger number of iconswhile the user can fly over the smaller size icon with a magnifyingtool, fly over area 220, with enhanced visibility.

Another embodiment of the present invention enables a user to controlthe magnification power of fly over area 220. For example, a user maydisplay an object displayed through display screen 110 twice as large asits smaller size by selecting two degrees of magnification. By using a“2” degree of magnification, the items of information directly under andwithin the fly over area 220 will be zoomed in and appear as large asits size during the normal operating mode, while other non-magnifieditems will be zoomed-out and appear smaller in size by a factor of “2,”thus the zoomed in item becomes clearly visible and legible to the user.

A navigation session begins when a user drags the fly over area 220 indirection 130, 140 or 160 of FIG. 1, in search of an item of information(e.g., icon 330). The user drags the fly over area 220 across displayscreen 110 with the aid of stylus 210.

FIG. 3 illustrates a navigation session for locating a desired item ofinformation (e.g., icon 330). The user places stylus 210 over the flyover area 220 and moves stylus 210 in direction 130′, 140 and 160 ofFIG. 1. The user navigates display screen 110 until icon 330 is foundunder the fly over area 220.

FIG. 1 also depicts display screen 110 when the fly over mode session isterminated. In one embodiment of the present invention, the user mayterminate the fly over mode session by removing stylus 210 from displayscreen 110. When the fly over mode session is terminated, display oficons on display screen 110 return to their normal size as depicted onFIG. 1.

FIG. 4A and FIG. 48 illustrate one embodiment of the present inventionwhere the user furthers the search beyond locating icon 330. The usermay activate icon 330 by pressing stylus 210 on icon 330 or doubleclicking on icon 330 and cause display of information, e.g., text,associated with icon 330.

In another embodiment of the present invention, the user may search fora particular line or a particular sentence within the displayed text.The search is conducted by navigating display screen 110 by moving flyover area 220 in directions 130, 140 and 160 of FIG. 1. The navigationprocess will continue, while the fly over area 220 (FIG. 48) slides overthe text and enhancing the legibility, until the desired line or thedesired sentence is found. It is appreciated that the type ofinformation is not limited to textual data, and in other embodiment ofthe present invention, the type information may be graphics, tables ofnumbers, calendars, maps of cities, telephone directories or the like.

FIGS. 5A, 5B, 5C, and 5D are exemplary illustrations of furtherembodiments of the present invention. According to this embodiment ofthe present invention, a user of system 500, equipped with a fly overarea, can search for an address and a direction to a named location in acity. System 500 is equipped with an internal memory (e.g., hard disk,RAM, PROM, RAM, EPROM, etc.) and may be adapted to receive an add-inmemory card complying with PCMCIA (e.g., PC card). The internal memoryor the add-in memory card contains the addresses for the residential andbusinesses located in the city B, along with the map of the city B.Furthermore, for the sake of this example, a user of the device can usesystem 500 to find a direction to a residential address 1322 on the 9thstreet.

FIG. 5A depicts display screen 110 when a fly over display mode sessionhas been initiated. A fly over display mode session is initiated when afly over area 220 appears on display screen 110. The user then cannavigate display screen 110 by moving fly over area 220 using stylus 210in direction 130, 140, and 160 of FIG. 1. As the user moves fly overarea 220 in directions 130, 140, and 160 of FIG. 1, the informationoutside the viewing area will scroll into the user viewing area. Thenavigation of information and scrolling of the information may continueuntil the desired item of information is found and placed under fly overarea 220. FIG. 5A depicts an instant where icon labeled “Addresses” isfound and is under fly over area 220.

FIG. 5B illustrates the next session in the search for the desiredaddress 1322 on the 9th street after icon labeled “addresses” is found.FIG. 5B illustrates that the user has terminated the fly over displaymode session by removing stylus 210 from display screen 110. FIG. 5Bdepicts display screen 110 in its normal mode of operation and a smallernumber of icons, including the desired icon labeled “addresses” remainon display screen 110 (e.g., a first amount of a graphical userinterface).

FIG. 5C is another embodiment of the present invention, where the userof system 500 who wishes to find the location of and a direction to1322, 9th street in city B continues the search and finds the list ofthe streets in the city. The user activates icon labeled “addresses” anda list of streets will appear on screen 110. The user scrolls the listin the directions 130, 140 or 160 of FIG. 1 until 9th street appearsunder a fly over area 220. It is appreciated that the sizes of the textin the fly over area 220 is larger than the size of text displayed onthe rest of the display screen 110. However, the text outside the flyover area 220 is smaller than the text originally displayed, as shown inFIG. 5B. Thus, more text in the graphical user interface is nowviewable.

FIG. 5D illustrates a view of a section of the map of the city B, wherethe 9th street is located. The user points stylus 220 on 9th street inFIG. 5B to get geographical location of 9th street. Accordingly,location of 9th street in relation with two major Interstates freewayswill appear under fly over area 220.

FIG. 6 is a flowchart of the steps in a computer implemented process 600for initiating a fly over mode and navigation of information in searchfor a desired item of information in accordance with an embodiment ofthe present invention.

In step 610 of FIG. 6, in one embodiment of the present invention, auser can activate the fly over mode by pointing a pointer to anon-active area of a display screen. In another embodiment of thepresent invention, a user can activate the fly over mode by clicking onan icon, on the display screen, which is specifically designated foractivation of the fly over mode.

In step 620 of FIG. 6, a fly over area appears on the display screen andthe user can move the fly over area in all directions by holding thepointer on the magnifying area and dragging the pointer in differentdirections. During the fly over mode, a larger number of items ofinformation, which are smaller in size (e.g., feature size), aredisplayed on the display screen.

In step 630 of FIG. 6, the user moves the fly over area over thedisplayed information on the display screen to locate a desired item ofinformation. Items of information appearing within the perimeter of thefly over area are magnified and are clearly legible.

In step 640 of FIG. 6, once the user finds the desired item ofinformation, the search may continue to get detail of the desired itemof information. The user points the pointer on the desired item ofinformation and clicks on the desired item of information.

In step 650 of FIG. 6, the user may terminate the navigation session andexit the fly over mode by removing the pointer from the screen. Once thesession is terminated, the display screen displays items of informationin their normally displayed sizes.

In summary, the present invention provides a method and a system thatenables a user to search through items of information, on a smalldisplay screen of a portable device, and expeditiously find a desireditem of information and legibly present the item of information to theuser. In accordance with the present invention, the portable computersystem may have the desired item of information stored in its databaseor in a PC card. It is appreciated that the embodiments of the presentinvention can be readily applied to the information received from theInternet or through the e-mail. While the present invention has beendescribed in particular embodiments, it should be appreciated that the #present invention should not be construed as limited by suchembodiments, but rather construed according to the below claims.

1. A method for implementing a touchscreen user interface for a device, the method comprising the steps of: a) displaying a plurality of items in a normal mode on a touchscreen of a portable electronic device; b) registering a user input to enter a fly over mode; c) in response to b), providing a fly over area within the touchscreen, wherein the fly over area provides a view of items within the fly over area, and wherein items outside the fly over area are zoomed out with respect to the items in the normal mode and the ones of the items; and d) controlling a location of the fly over area with respect to the touchscreen in accordance with a movement command received from a user. 